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DESCRIPTION 

ENCODED DATA RECORDING APPARATUS 
AND MOBILE TERMINAL 

5 

Technical Field 
The present invention relates to an encoded data 
recording apparatus and a mobile terminal used for 
example in a system handling encoded data. 
0 Background Art 

In recent years, various information transmission 
systems such as a broadcasting system, a cable communi- 
cation system and a mobile communication system have 
been put to practical use or planed, and as a result 
S thereof, various terminals have been developed. 

For example, in a mobile communication system, 
mobile terminals such as mobile phones and PDAs 
(Personal Digital Assistants) are used. In this kind 
of terminals, not only voice communication service, but 
> also various transmission services such as SMS (Short 

Message Service), electronic mail service and 
information distribution service using wireless 
internet are available. When data including a large 
amount of information such as motion picture data (or 
video data) are tried to transmit in the mobile 
communication system, they cannot be transmitted as 
they are because the transmission path band causes a 
bottleneck. 
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So, a compression/extension processing of video 
data is required in transmitting motion picture data 
wirelessly, and as one means of realizing the 
processing, the employment of a compression/extension 
scheme called MPEG-4 (Moving Picture Experts Group-4) 
is being discussed. 

MPEG-4 represents data having correlations on the 
time axis such as video data with an initial frame and 
a difference frame. The initial frame is called 
I-Frame (Intra-coded Frame) and contains whole picture 
information elements (absolute value information) of 
one picture obtained by being compressed as a still 
picture.. That is , the I-Frame composes a picture frame 
having an independent meaning alone. In contrast 
thereto, the difference frame is called P-Frame 
(Predictive-coded Frame) and mainly contains difference 
information between the picture of the current frame 
and the picture of the preceding frame. And, in the 
first timing after the start of transmission an I-Frame 
is transmitted, and in the subsequent frame timings 
P-Frames are transmitted sequentially. By using MPEG-4, 
motion picture data having an amount of information 
equivalent to several Mbps can be transmitted with 
being compressed to several ten Kbps . 

However, in a system employing such a 
compression/extension scheme, if the video recording 
button of the apparatus is pushed in receiving data, 
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only difference frames can be recorded, and as a result 
thereof, it becomes difficult to reproduce pictures 
effectively from the recorded video data. 

So, in MPEG-4, an idea that the picture of each 
P-Frame is divided into a large number of blocks and 
that absolute value information is transmitted in a 
part of blocks selected optionally from each P-Frame is 
employed. The blocks in which the absolute value 
information is transmitted are called a macro-block 
respectively. By receiving a plurality of P-Fr antes and 
synthesizing the macro-blocks thereof, the apparatus 
can reproduce one picture data equivalent to picture 
data of the I-Frame. 

Therefore, even if the picture recording button of 
the apparatus is pushed in receiving picture data, one 
picture data comprising absolute value information can 
be reproduced by receiving the same number of P-Frames 
as the macro-blocks constituting one picture. 

However, in a period from the start of video 
recording to the end of receiving the same number of 
P-Frames as the macro-blocks constituting one picture, 
one picture data comprising absolute value information 
cannot be reproduced. The above-described period lasts, 
for example, about 10 seconds. As a result thereof, 
users may fail to record video data of desired scenes. 

Disclosure of Invention 
The present invention has an object of providing 
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an encoded data recording apparatus and a mobile 
terminal adapted to be able to record high-quality data 
immediately after inputting a recording instruction 
even if the recording is begun during data input or 
data reception. 

In order to attain the above-described object, the 
encoded data recording apparatus according to the 
present invention is an apparatus recording encoded 
data composed of first data generated in the initial 
frame timing and a plurality of second data generated 
respectively in the subsequent frame timings and 
comprises an encoded data input means for inputting the 
encoded data, a data reproduction processing means for 
reproducing the original data based on the first data 
15 and the second data of the encoded data inputted by the 

data input means, a recording period specifying means 
for specifying the recording period of the encoded data 
from a user of the apparatus, and a recording control 
means. And, when the recording period is specified by 
the recording period specifying means in inputting the 
encoded data, the original data reproduced by the data 
reproduction processing means in the recording period 
concerned is recorded in a recording medium by the 
recording control means. 

Therefore, according to the present invention, 
when a recording instruction is inputted in receiving 
data, the original data reproduced by the data 
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reproduction processing means will be recorded in the 
recording medium from this time on. Accordingly, high- 
quality original data equivalent to the first data can 
be recorded immediately after the recording instruction 
5 was inputted. Therefore, recorded data are reproduced, 

high-quality data can be reproduced from the time of 
having inputted the recording instruction. 

Moreover, the present invention is characterized 
in that the recording control means records original 
10 data reproduced by the data reproduction processing 

means in the recording medium in the first frame timing 
of the recording period and in that it records second 
data inputted by the encoded data input means in the 
recording medium in the frame timings following the 
15 first frame timing respectively. 

Further, the present invention is characterized in 
that the recording control means re-encodes original 
data into first data and a plurality of second data 
when it records reproduced original data in the 
20 recording medium. And, the present invention is also 

characterized in that the first data and the plurality 
of second data obtained by the re-encoding are recorded 
in the recording medium. 

Due to such a composition , original data 
>5 equivalent to first data are recorded only at the 

starting time of recording, and in the subsequent 
recording period inputted first data is recorded as it 
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is. Accordingly, the amount of data recorded in the 
recording medium can be reduced substantially through 
the recording period in comparison to storing 
reproduced original data. Therefore, the storage 
capacity of a recording medium can be used more 
effectively, and it becomes possible to prolong the 
recording time of data. 

Further, in the present invention, the recording 
control means temporarily holds original data 
reproduced by the data reproduction processing means in 
the recording period till the input period of the 
encoded data ends. And, the present invention is also 
characterized in that after the end of the input period 
of the encoded data the temporarily held original data 
are re-encoded in first data and a plurality of second 
data and are recorded in the recording medium. 

Due to such a composition, the amount of data 
recorded in the recording medium can be reduced 
substantially to prolong the data recording time. 
Moreover, it becomes possible to carry out the 
processing of re-encoding reproduced original data into 
first data and second data except in the receiving 
period and the recording period of encoded data. As a 
result thereof, no concentrated processing load can be 
realized in receiving and recording encoded data, 
thereby reducing the processing burden of a CPU or a 
DSP . 
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Brief Description of Drawings 
FIG. 1 is a view showing the schematic organiza- 
tion of a mobile communication system that is a first 
embodiment of a data transmission system in which an 
5 encoded data recording apparatus according to the 

present invention is used; 

FIG. 2 is a view showing the layer structure of a 
multimedia transmission system according to MPEG-4 ; 
FIG. 3A and FIG. 3B are views showing the 
10 appearance of a mobile terminal that is a first 

embodiment of the encoded data recording apparatus 
according to the present invention respectively; 

FIG. 4 is a block diagram showing the functional 
composition of the mobile terminal shown in FIG. 3A and 
15 FIG. 3B; 

FIG. 5 is a view for illustrating the operation of 
a video data compression scheme using MPEG-4; 

FIG. 6 is a view showing a first example of the 
recording operations of video data carried out by means 
2 0 of the mobile terminal shown in FIG. 4; 

FIG. 7 is a view showing a second example of the 
recording operations of video data carried out by means 
of the mobile terminal shown in FIG. 4; 

FIG. 8 is a block diagram showing the functional 
25 organization of a mobile terminal that is a second 

embodiment of the encoded data recording apparatus 
according to the present invention; 
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FIG. 9 is a view showing the recording operations 
of picture data carried out by means of the mobile 
terminal shown in FIG. 8; 

FIG. 10 is a block diagram showing the functional 
5 organization of a mobile terminal that is a third 

embodiment of the encoded data recording apparatus 
according to the present invention; and 

FIG. 11 is a view showing the recording operations 
of video data carried out by means of the mobile 
10 terminal shown in FIG. 10. 

Best Mode for Carrying Out of the Invention 
Now, several embodiments of the encoded data 
recording apparatus according to the present invention 
will be described with reference to the drawings. 
15 (First Embodiment) 

In a first embodiment of the present invention, 
the present invention is applied to a mobile terminal 
having an encoded data recording function. It is 
assumed that a picture frame transmitted from the 
20 terminal of a communication partner side is decoded and 

displayed on a display section during communication by 
means of wireless TV phones using MPEG-4. When a user 
carries out a recording start operation in this 
condition, decoded video data generated to be displayed 
15 on the display section are recorded sequentially in a 

main recording section till a video recording end 
operation is carried out. 
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FIG. 1 is a schematic organization view of a 
mobile communication system according to this first 
embodiment. In the same figure , a plurality of base 
stations BS1, BS2, . .. are distributed in a service 
5 area covered by the system. These base stations BS1 , 

BS2 f ... are connected respectively to a network NW. 
Mobile terminals MSI, MS2 , ... are connected 
respectively to the nearest base stations BSl, BS2 f ... 
over radio channels and are further connected from 

10 these base stations BSl, BS2 , ... to the network NW. 

In the network NW, corresponding to the calling 
requests of the mobile terminals MSI, MS2 , ...„ a 
processing for connecting between the mobile terminals 
MSI and MS2 by means of switching is carried out. And, 

15 once a communication link has been established between 

the mobile terminals MSI and MS 2 by means of the 
switching connection processing, TV phone communication 
is subsequently permitted between these mobile 
terminals MSI and MS2. 

20 Moreover, as the above-described wireless access 

scheme, a W-CDMA (Wideband-Code Division Multiple 
Access) scheme is, for example, used. As other 
wireless access schemes, a cdma 2000 scheme, a FDMA 
(Frequency Division Multiple Access) scheme, a TDMA 

2 5 (Time Division Multiple Access) scheme, or a Narrowband 

CDMA scheme may be also employed. 

FIG. 2 is a view showing the scheme of wireless TV 
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phone communication in the mobile communication system 
by means of multiplexing transmission of motion picture 
data (or video data), speech data and computer data 
between the mobile terminals MSI and MS 2 . 

The mobile terminals MSI and MS 2 are connected to 
each other by means of a physical layer (concretely, a 
mobile switching network NW) . And data are transmitted 
in a packet called MUX-PDU as a unit. In the MUX-PDU, 
as shown in FIG. 2, a flag and a header are disposed on 
the head end, and behind them the video data, speech 
data and computer data are disposed alternately. 
Control information representing the contents of the 
MUX-PDU is inserted into the header. 

Above the physical layer an AL/MUX layer 
(concretely, a multiple separation section) is disposed 
In this AL/MUX layer the MUX-PDU is generated. 
Moreover, above the AL/MUX layer a higher-grade layer 
is disposed. In this layer a video channel, an audio 
channel and a control data channel are connected. The 
higher-grade layer is realized by means of a multimedia 
processing section described later, a speech codec 
section and a data communication section. 

Video data are bundled and transmitted via the 
video channel. A MPEG-4 stream is embedded into the 
video channel. In this MPEG-4 stream, as shown in 
FIG. 4 described later, an I-Frame containing all the 
picture elements of one picture is transmitted first. 
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In the subsequent frame timings, P-Frames containing 
mainly difference data between a current frame and the 
preceding frame are transmitted sequentially. 

Now, the mobile terminals MSI, MS2, ... are 
5 composed respectively as follows. FIGS. 3A and 3B show 

the appearance thereof, and FIG . 3A is a front view and 
FIG. 3B is a side view. 

These mobile terminals MSI and MS2 have a wireless 
TV phone communication function. On the front panel of 
.0 the casing there are mounted a microphone 31, a speaker 

32, a liquid crystal display (LCD) 34 and a key input 
section 35. And a telescopic antenna 11 and a camera 
33 are provided on the top of the casing. This camera 
3 3 employs a solid pickup device such as a CMOS or CCD 
5 and can pick up still pictures or motion pictures. 

Further, on the rear of the casing there is provided a 
battery mounting section. A battery pack composing a 
power source section 4 is detachably mounted in this 
mounting section. 
0 Now, the circuit of the mobile terminals MSI, 

MS2, ... is composed respectively as follows. FIG. 4 
is a block diagram showing the composition. 

That is, the mobile terminals MSI, MS2 , ... are 
composed of a radio section 1, a base band section 2, 
5 an input/output section 3 and a power source section 4 

respectively. 

Radio frequency signals coming from the base 
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stations BS1, BS2 , ... over radio channels for the 
mobile communication system are received at the antenna 
11 and are subsequently inputted into a receiving 
circuit (RX) 13 via a duplexer (DUP) 12. The receiving 
5 circuit 13 is provided with a low-noise amplifier, a 

frequency converter and a demodulator. 

And, after being amplified by means of the low- 
noise amplifier, the radio frequency signals are mixed 
with received local oscillating signals in the 
10 frequency converter and are down-converted into 

received intermediate frequency signals or received 
base band signals, and the output signals are 
demodulated digitally by means of the demodulator. 
Demodulation is carried out in steps of a primary 
15 demodulation and a secondary demodulation. As a 

primary demodulation scheme a spectrum reversed 
diffusion using diffusion codes is employed, and as a 
secondary modulation scheme an orthogonal demodulation 
scheme complying, for example, with a QPSK (Quadriphase 
2 0 Phase Shift Keying) scheme is employed. Further, the 

received local oscillating signals are generated by 
means of a frequency synthesizer (SYN) 14 according to 
the instruction of a main control section 21A. 

Demodulated data outputted from the demodulator 
25 are inputted into a base band section 2. The base band 

section 2 is provided with a main control section 21A, 
a multiple separation section 22, a voice code decoding 
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section (hereafter referred to as a voice codec) 23, a 
multimedia processing section 24, a temporary storage 
section 25, and a main storage section 26. 

Among them, the temporary storage section 25 
comprises, for example, a ring buffer or FIFO (First-in 
First-out) memory, and according to the instruction of 
the main control section 21A, it temporarily holds 
displaying video data reproduced by the decoding 
processing in the multimedia processing section 24 and 
non-decoded received picture frames outputted from the 
multiple separation section 22. 

The main storage section 2 6 comprises, for example, 
a RAM (Random Access Memory) or a EEPROM (Electrically 
Erasable and Programmable Read Only Memory), and 
according to the instruction of the main control 
section 21A, it selectively holds decoded displaying 
video data and non-decoded received picture frames 
transferred from the temporary storage section 25. 
Further, a portable flash EEPROM or the like detachable 
from mobile terminals can be used in this main storage 
section 26. 

In the main control section 21A it is identified 
whether the demodulated data are control information 
or multimedia information. As a result of this 
identification, if the demodulated data are multimedia 
information, they are inputted into the multiplex/ 
demultiplex section 22 and are divided here into 
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received voice data and received video data. And the 
received speech data are inputted into the speech codec 
2 3 and are decoded here into speech signals. These 
decoded speech signals are amplified and outputted from 
5 the speaker 32 of the input/output section 3. 

On the other hand, the received video data are 
inputted into the multimedia processing section 24 and 
are decoded into picture data by frame. These video 
data are fed to the liquid crystal display (LCD) 34 of 
10 input /output section 3 and are displayed. 

Further, various kinds of information indicating 
the operational conditions of this apparatus outputted 
form the main control section 21A are also displayed on 
this LCD 34. This displayed information includes, for 
15 example, a telephone book, a detected receiving 

electric field intensity value and a remaining amount 
of power in batteries . 

On the other hand, the transmitted speech signals 
of a terminal user outputted from the microphone 31 of 
2 0 the input /output section 3 are inputted into the speech 

codec 23 of the base band section 2A. And, after 
having been processed into encoded speech data here, 
they are inputted into the multiplex/demultiplex 
section 22. Further, the video signals of the face of 
25 a terminal user picked up by the camera (CAM) 3 3 are 

inputted into the multimedia processing section 2 4 of 
the base band section 2A. And, after having been 
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processed into encoded video data here, they are 
inputted into the multiplex/demultiplex section 22. 

In the multiplex/demultiplex section 22, the 
encoded speech data and the encoded video data are 
5 multiplexed according to a specified format prescribed 

by ITU-T H.2 23 or the like. These multiplexed 
transmitted data are inputted from the main control 
section 21A into the transmitting circuit (TX) 15 of 
the radio section 1 . 

10 The transmitting circuit 15 is provided with a 

modulator, a frequency converter and a transmitted 
power amplifier. In the modulator transmitted 
intermediate frequency signals are modulated digitally 
by the transmitted data. Modulation is carried out in 

15 steps of a primary modulation and a secondary 

modulation. As a primary modulation scheme, for 
example, a QPSK scheme is employed, and as a secondary 
modulation scheme there is employed a scheme in which 
signals after the primary modulation are spectrum- 

20 diffused by means of diffusion codes. In the frequency 

converter transmitted intermediate frequency signals 
modulated by the modulator are mixed with transmitted 
local oscillating signals and are up-converted into 
radio frequency signals with respect to the frequency. 

25 Further, the transmitted local oscillating signals are 

generated by the frequency synthesizer 14 according to 
the instruction of the main control section 21A. 
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By means of the transmitted power amplifier the 
transmitted radio frequency signals outputted from the 
frequency converter are amplified to a specified 
transmitted power level instructed by the main control 
5 section 21A. And they are fed to the antenna 11 via 

the duplexer 12 and are radiated from this antenna 11 
towards base stations (not shown). 

Further, in the power source section 4 there are 
provided a battery 41 using lithium ion cells, a 
10 charging circuit (CHG) 42 for charging this battery 41, 

and a voltage generation circuit (PS) 43. The voltage 
generation circuit 43 comprises, for example, a DC/DC 
converter and generates a specified power source 
voltage Vcc based on the output voltage of the 
15 battery 41. 

And in the input/output section there is provided 
an illuminator 36. This illuminator 36 is called, 
for example, a back light or an illumination and 
illuminates the LCD 34 and the key input section 35 
20 when a user operates keys or during communication. 

The main control section 21A is provided with a 
microprocessor and an internal memory comprising a ROM, 
a RAM and the like. Further, it is newly provided with 
a displayed data recording control means 21a in 
25 addition to the usual control functions such as a 

connection control function and communication control 
function of radio channels. These control functions 
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are realized by a control program contained in the ROM . 

This displayed data recording control means 21a 
operates when a user carries out a video recording 
start operation in the input/output section 3 during TV 
5 phone communication operation. And in a period from 

the time of this video recording start operation to the 
time of the video recording end operation, display 
video data decoded and reproduced in the multimedia 
processing section 24 are fed to the main storage 
10 section 2 6 via the temporary storage section 25 and are 

stored sequentially so that they may be displayed on 
the LCD 34. 

Moreover, the displayed data recording control 
means 21a has also a function of feeding display video 
15 data reproduced by means of a decoding processing at 

the time of the video recording start operation and 
each received picture frame outputted from the multiple 
separation section 22 in a period from the time of the 
video recording start operation to the time of the 
20 video recording end operation to the main storage 

section 2 6 via the temporary storage section 2 5 and of 
storing them sequentially. 

Now, the recording operations of received video 
data in the mobile terminals MSI, MS2, ... composed as 
2 5 described above will be described. 

(First Operation Example) 

Suppose that the mobile terminal MSI and the 
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mobile terminal MS2 shown in FIG . 1 start wireless TV 
phone communication using MPSG-4 . Then, the mobile 
terminal MSI generates first an I-Frame in the initial 
frame timing based on the video data outputted from the 
5 camera 33 and transmits this I-Frame. And in each 

frame timing after the second frame, a P-Frame mainly 
composed of difference information between the video 
data of the current frame and the video data of the 
previous frame is generated, and this P-Frame is 

10 transmitted sequentially. 

On the other hand, the mobile terminal MS2 
receives first the I-Frame transmitted from the mobile 
terminal MSI, reproduces one-picture data in the 
multimedia processing section 24 based on this I-Frame 

15 and displays these one-picture data on the LCD 34. And 

in the subsequent frame timings respectively the 
P-Frames transmitted from the mobile terminal MSI are 
received sequentially. And by adding these P-Frames 
to the picture data reproduced by means decoding 

20 processing respectively in the previous frames, the 

one-picture data are reproduced, and these one-picture 
data are displayed sequentially on the LCD 34. 

FIG. 5 shows an operation example of the video 
data transmission scheme using the MPEG-4 in the form 

25 of a model. In the same figure, suppose that video 

data shown in VI, V2 , V3 , ... are outputted 
sequentially from the camera 33, for example, in the 
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mobile terminal MS 1 of the transmitting side. Then the 
mobile terminal MSI encodes first the picture data VI 
as still picture data and transmits the encoded picture 
data obtained thereby as an I-Frame. On the other hand, 
5 the mobile terminal MS 2 reproduces one-picture data VI 1 

based on the received I-Frame and displays this on the 
LCD 34. 

Next, each time the picture data V2 , V3 , ... are 
outputted from the camera 33, the mobile terminal MSI 
10 detects the differences between these picture data V2, 

V3, ... and the picture data VI, V2 , ... of the 
previous frame respectively. And picture data mainly 
composed of this difference information are generated 
respectively and these picture data are transmitted as 
15 a P-Frame. On the other hand, each time the P-Frame is 

received, the mobile terminal MS2 adds the difference 
information thereof to the display picture data VI ' , 
V2 ' , ... produced in the previous frames respectively, 
thereby reproducing one-picture data. And these 
2 0 reproduced display picture data V2 ' , V3 ' , ... of one- 

picture are displayed sequentially on the LCD 34. 

Now, suppose that a user has inputted a video 
recording start instruction by operating the key input 
section 35, for example, in the mobile terminal MS2 in 
25 a condition of carrying out the TV phone communication 

as described above. 

Then the main control section 21A of the mobile 
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communication terminal MS2 feeds display video data 
reproduced by means in the multimedia processing 
section 24 to the main storage section 26 via the 
temporary storage section 25 at this time and stores 
5 them in the main storage section 26. And the display 

data received subsequently till the recording end 
operation and reproduced in the multimedia processing 
section 2 4 are respectively fed to the main storage 
section 26 via the temporary storage section 15 
10 sequentially and are stored in the main storage section 

26. FIG. 6 shows how this recording operation is 
carried out. 

Therefore , even if the video recording start 
operation is carried out in receiving a video data 
15 stream, display video data reproduced by the decoding 

processing in the multimedia processing section 24 are 
recorded sequentially in the main storage section 2 6 
from the time of the operation. As a result thereof , 
when the display video data recorded in the main 
2 0 storage section 2 6 are reproduced, high quality video 

data equivalent to the I-Frame can be reproduced from 
the time of the video recording start operation. 
(Second Operation Example) 

In the first operation example described above, 
2 5 in the whole period from the video recording start 

operation to the video recording end operation, display 
video data decoded in the multimedia processing section 
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24 and equivalent to the I-Frame are recorded in the 
main storage section 26. 

However, the storage of display video data is not 
limited thereto. For example, as shown in FIG. 7 , only 
5 at the time of the video recording start, display video 

data decoded in the multimedia processing section 24 
and equivalent to the I-Frame are recorded in the main 
storage section 26. And in the subsequent period till 
the video recording end operation, received picture 

10 frames, that is, P-Frames, may be stored in the main 

storage section 26. 

By doing this, over the whole period from the 
video recording start operation to the video recording 
end operation, in comparison to the case in which 

15 display video data decoded in the multimedia processing 

section 24 and equivalent to the I-Frame are recorded, 
the amount of video data recorded in the main storage 
section 26 can be reduced substantially. As a result 
thereof, the storage capacity of the main storage 

20 section 26 can be used effectively, thereby prolonging 

the recording time of video data. 
(Second Embodiment) 

In a second embodiment of the present invention, 
at the time of a video recording start operation 
2 5 carried out by a user, display video data reproduced by 

a decoding processing in the multimedia processing 
section are returned to the multimedia processing 
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section, are re-encoded into an I-Frame and are 
subsequently stored in the main storage section* 
Further, in a period from the time of the video 
recording start operation to the time of a video 
5 recording end operation, display video data reproduced 

by a decoding processing in the multimedia processing 
section are returned to the multimedia processing 
section, are re-encoded into P-Frames and are stored in 
the main storage section. 

10 FIG. 8 is a block diagram showing the functional 

organization of a mobile terminal having an encoded 
data recording function according to the second 
embodiment. Further, in the same figure, the identical 
sections to FIG- 4 are marked with the identical 

15 symbols, and detailed descriptions will be omitted. 

The main control section 2 IB of a base band 
section 2B is provided with a displayed data recording 
control means 21b and a re-encoding control means 21c 
as new control functions according to the present 

20 invention. 

When a video recording start operation is carried 
out in the input /output section 3 during communication, 
the displayed data recording control means 21b carries 
out main processing operations for storing display 

2 5 video data reproduced by a decoding processing in the 

multimedia processing section 24 in the main storage 
section 2 6 for a period from the time of this video 
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recording start operation to the time of a video 
recording end operation. 

When the displayed data recording control means 
21b stores the display video data in the main storage 
5 section 26, the re-encoding control means 21c returns 

these display video data to be recorded to the 
multimedia processing section 24 and re-encodes them. 
And an I-Frame and P-Frames generated by this re- 
encoding are stored in the main storage section 26. 

10 In such a composition f supposes that a user 

carries out a picture recording start operation during 
TV phone communication. Then the main control section 
2 IB inputs display video data reproduced by means of a 
decoding processing in the multimedia processing 

15 section 24 into the encoding section in the multimedia 

processing section at the time of this video recording 
start operation. And an I-Frame obtained by a re- 
encoding processing in this encoding section is stored 
in the main storage section 26 via the temporary 

2 0 storage section 25. 

For a period till a user carries out a video 
recording end operation, each time display video data 
are reproduced by a decoding processing of the 
multimedia processing section 24, the display video 

25 data are inputted into the encoding section in the 

multimedia processing section 2 4 and are re-encoded. 
And P-Frames generated by this re-encoding processing 
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are stored sequentially in the main storage section 26 
via the temporary storage section 25. 

FIG. 9 shows how the recording operation of video 
data using this re-encoding processing is carried out. 
5 Further, for a period from the video recording 

start operation to the video recording end operation , 
the main control section 2 IB stops the encoding 
processing of transmitted video data in the multimedia 
processing section 24 temporarily for re-encoding 

10 display video data. 

As described above, according to the second 
embodiment, display video data reproduced by a decoding 
processing in the multimedia processing section 24 are 
re-encoded in the multimedia processing section 2 4 and 

15 are recorded in the main storage section 26. Therefore, 

the received video data can be recorded in a compressed 
condition. Accordingly, the amount of video data 
recorded in the main storage section 2 6 can reduced. 
As a result thereof, the storage capacity of the main 

20 storage section 26 can be used more effectively, 

thereby prolonging the recording time of video data. 

Moreover , the re-encoding processing of display 
video data is carried out in the encoding section of 
the existing multimedia processing section 24. 

2 5 Therefore, no encoder for re-encoding is newly required. 

Accordingly, a mobile terminal with larger-sized 
circuitry can be avoided. 
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(Third Embodiment) 

In a third embodiment according to the present 
invention , when a user carries out a video recording 
start operation during wireless TV phone communication 
5 using MPEG- 4 , display video data reproduced by a 

decoding processing in the multimedia processing 
section for a period from the time of this picture 
recording operation to the time of a picture recording 
end operation are held temporarily in the temporary 

10 storage section* And, after the end of the TV phone 

communication, the display video data held in the 
temporary storage section are read out, are inputted 
into the multimedia processing section and are re- 
encoded into an I-Frame and a plurality of subsequent 

15 P-Frames. And the I-Frame and the plurality of 

subsequent P-Frames obtained by means of this re- 
encoding are stored in the main storage section. 

FIG. 10 is a block diagram showing the functional 
organization of a mobile terminal having an encoded 

2 0 data recording function according to the second 

embodiment. Further, in the same figure, the identical 
sections to FIG. 8 are marked with the identical 
symbols, and detailed descriptions will be omitted. 
The main control section 21C of a base band 

2 5 section 2C is provided with a displayed data holding 

control means 2 Id, a displayed data recording control 
means 21e and a re-encoding control means 2 If as new 
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control functions according to the present invention. 

When a user carries out a video recording start 
operation during wireless TV phone communication, 
display video data reproduced by a decoding processing 
5 in the multimedia processing section 24 for a period 

from the time of this video recording start operation 
to the time of a video recording end operation are held 
temporarily in the temporary storage section 25. 

The displayed data recording control means 21e 

10 monitors the end of the wireless TV phone communication. 

And the communication comes to end, the display video 
data held in the temporary storage section 25 are read 
out and are inputted into the multimedia processing 
section 24. And an I-Frame and P-Frames obtained by 

15 this re-encoding processing in the multimedia 

processing section 24 are stored in the main storage 
section 26. 

The re-encoding control means 2 If controls the 
operation of the multimedia processing section 2 4 and 

2 0 re-encodes the display video data read out from the 

temporary memory section 25. 

Due to such a composition, when a video recording 
start operation is carried out during communication, 
display video data decoded by the multimedia processing 

25 section 24 for a period from the time of this video 

recording start operation to the time of a video 
recording end operation are transferred to the 
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temporary storage section 25 and are held therein under 
control of the main control section 21C. And 
subsequently, when the end of communication is detected, 
the display video data held in the temporary storage 
5 section 25 are read out sequentially in order of time 

under control of the main control section 21C r are 
inputted into the encoding section of the multimedia 
processing section 24 and are re-encoded into an 
I-Frame and subsequent P-Frames. And these re-encoded 

10 I-Frame and P-Frames are stored in the main storage 

section 26 via the temporary storage section 25. 

Therefore, according to the third embodiment, as 
in the second embodiment, since display video data are 
re-encoded in the multimedia processing section 24 and 

15 are recorded in the main storage section 26, the 

received video data can be recorded in a compressed 
condition. Accordingly, the amount of video data 
recorded in the main storage section 2 6 can reduced. 
As a result thereof, the storage capacity of the main 

20 storage section 26 can be used more effectively, 

thereby prolonging the recording time of video data. 

Further, in the third embodiment, the re-encoding 
processing is carried out after the end of communica- 
tion. Therefore, the re-encoding processing of video 

2 5 data to be recorded is permitted without stopping the 

encoding processing of transmitted data by the 
multimedia processing section 24 temporarily. Moreover, 

MSDOCID: <WO 0167775A2J_> 



WO 01/67775 



PCT/JP01/01740 



28 

the processing load of the main control section 21C can 
be reduced, and therefore, no CPU or DSP having a high 
processing capability is required. 
(Other Embodiments) 
5 In the second embodiment, when display video data 

are re-encoded in the multimedia processing section 24, 
the encoding processing of transmitted data is stopped 
temporarily. However, the multimedia processing 
section 24 has a sufficient signal processing 

10 capability, the encoding processing of transmitted 

picture data and the re-encoding processing of display 
video data may be carried out in time sharing. 

As a result thereof , received video data can be 
recorded concurrently with video data being transmitted. 

15 Further, after the end of communication, recorded 

received picture data can be reproduced instantaneously. 

Moreover, another video encoder for re-encoding 
display video data may be provided in addition to the 
multimedia processing section 24 and the re-encoding 

2 0 processing of display video data may be carried out by 

this picture encoder. In this case, as a video encoder 
for re-encoding display video data, an encoder 
permitting a higher-quality encoding such as a MPEG-2 
encoder is preferably used. 

25 Further, as an encoding compression/extension 

scheme of video data, other schemes such as ITU-T H.263 
or the like than MPEG-4 may be employed, and with 
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respect to data to be transmitted, still video data and 
other data may be transmitted in addition to motion 
picture data. 

Further , in the above-described embodiments , a 
5 case in which wireless TV phone communication is 

maintained between the mobile terminals MSI and MS2 is 
described. However, in addition thereto, the present 
invention is also applicable, for example, to a case in 
which a mobile terminal is connected to a WWW server or 

10 the like on Internet via a network NW and information 

contained in a home page or the like is down-loaded 
from this server. Moreover, the present invention is 
also applicable to a case in which an electronic mail 
accompanied by motion picture data is received. 

15 In the above-described embodiments, a mobile 

communication is described as an example. However, 
the present invention can be applied to a radio 
transmission system and the like between equipment 
using a short distance radio data transmission scheme 

2 0 represented by wireless LAN and BT (Bluetooth), and 

further it may be applied to a cable transmission 
system such as a subscriber network using metallic 
cables or optical fiber cables and a cable television 
broadcasting network. 

2 5 Moreover, as an encoded data recording apparatus, 

a recorder or the like recording video data or audio 
data received by a television tuner or a car radio is 
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included in addition to communication terminals such as 
a mobile terminal, a PDA and a personal computer. 

Further, as an encoded data input means, means 
acquiring data from a mobile recording medium such as a 
5 CD, a DVD or a memory card are included in addition to 

means into which encoded data are inputted from an 
external equipment by using a cable or a radio link. 

And besides, it is to be understood that various 
changes in the kind and the composition of terminals, 
10 the construction of a re-encoding means and the like 

may be made without departing the summary of the 
present invention. 

Industrial Applicability 
As described above in detail, in the present 
15 invention, when a data display control means for 

receiving first data and second data, reproducing frame 
data of each frame based on these data and displaying 
the frame data sequentially on the display is provided, 
at least the newest frame data are held temporarily in 
2 0 the data holding means each time frame data are 

reproduced by this data display control means. And 
when a recording instruction of the received data is 
inputted in receiving the first data and the second 
data, reproduced frame data held temporarily in the 
2 5 data holding means are recorded in a recording medium 

in the order corresponding to the time of having 
inputted the recording instruction. 



JNSDOCID: <WO 0167775A2_.L> 



WO 01/67775 



PCT/JP01/01740 



31 

Therefore , according to the present invention, 
there can be provided an encoded data recording 
apparatus and a mobile terminal capable of recording 
high-quality data immediately after having inputted a 
5 recording instruction by using reproduced display frame 

data even if recording is begun in receiving data. 
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CLAIMS 
1 . An encoded data recording apparatus for 
recording encoded data composed of first data generated 
based on original data having correlations on the time 
5 axis in an initial frame timing thereof and of a 

plurality of second data generated respectively in a 
plurality of frame timings subsequent to said initial 
frame timing , said first data having an independent 
meaning alone and said plurality of second data 
10 containing mainly a difference between the original 

data of a current frame and the original data of the 
preceding frame respectively, said apparatus 
comprising: 

encoded data input means for inputting said 
15 encoded data; 

data reproduction processing means for reproducing 
said original data based on the first data and the 
second data of the encoded data inputted by means of 
this data input means; 
20 recording period specifying means for specifying 

the recording period of said encoded data; and 

recording control means for recording the original 
data reproduced by said data reproduction processing 
means in the recording period concerned in a recording 
25 medium when the recording period is specified by said 

recording period specifying means in period inputting 
said encoded data. . 
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2 . The encoded data recording apparatus according 
to claim 1, wherein said recording control means 
records the original data reproduced by said data 
reproduction processing means in a recording medium in 

5 the first frame timing of said recording period and 

records the second data inputted by said encoded data 
input means in said recording medium in the frame 
timings subsequent to said first frame timing. 

3 . The encoded data recording apparatus according 
10 to claim 1, wherein said recording control means 

comprises : 

re-encoding means for re-encoding the original 
data reproduced by said data reproduction processing 
means in said recording period into first data and a 
15 plurality of second data; and 

means for recording the first data and the 
plurality of second data obtained by said re-encoding 
means in said recording medium. 

4 . The encoded data recording apparatus according 
20 to claim 1, wherein said recording control means 

comprises : 

recorded data holding means for holding the 
original data reproduced by said data reproduction 
processing means in said recording period temporarily 
25 till the input period of said encoded data comes to an 

end; and 

means for re-encoding the original data held 
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temporarily in said recorded data holding means into 
first data and a plurality of second data and recording 
them in said recording medium after the input period of 
said encoded data has come to an end. 
5 5. A mobile terminal for receiving over radio 

channels and recording encoded data composed of first 
data generated based on the original data having 
correlations on the time axis in the initial frame 
timing thereof and of a plurality of second data 

10 generated respectively in a plurality of frame timings 

subsequent to said initial frame timing, said first 
data having an independent meaning alone and said 
plurality of second data containing mainly a difference 
between the original data of a current frame and the 

15 original data of the preceding frame respectively, said 

mobile terminal comprising: 

radio receiving means for receiving encoded data 
transmitted over said radio channels; 

data reproduction processing means for reproducing 

2 0 said original data based on the first data and the 

second data of the encoded data received by said radio 
receiving means; 

recording period specifying means for specifying 
the recording period of said encoded data; and 

2 5 recording control means for recording the original 

data reproduced by said data reproduction processing 
means in the recording period concerned in a recording 
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medium when the recording period is specified by said 
recording period specifying means in receiving said 
encoded data. 

6. The mobile terminal according to claim 5, 
5 wherein said recording control means records the 

original data reproduced by said data reproduction 
processing means in a recording medium in the first 
frame timing of said recording period and records the 
second data of the encoded data received by said radio 
10 receiving means in said recording medium in the frame 

timings subsequent to said first frame timing. 

7. The mobile terminal according to claim 5, 
wherein said recording control means comprises: 

re-encoding means for re-encoding the original 
15 data reproduced by said data reproduction processing 

means in said recording period into first data and a 
plurality of second data; and 

means for recording the first data and the 
plurality of second data obtained by said re-encoding 
2 0 means in said recording medium. 

8. The mobile terminal according to claim 7, 
wherein, when transmission encoding means for encoding 
the original data to be transmitted into first data and 
a plurality of second data and transmitting them 

25 wirelessly is provided , 

said transmission encoding means functions also as 
said re-encoding means. 
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9. The mobile terminal according to claim 5, 
wherein said recording control means comprises: 

recorded data holding means for holding the 
original data reproduced by said data reproduction 
5 processing means in said recording period temporarily 

till the receiving period of said encoded data comes to 
an end; 

re-encoding means for re-encoding the original 
data held temporarily in said recorded data holding 
10 means into first data and a plurality of second data 

after the receiving period of said encoded data has 
come to an end; and 

means for recording the first data and the 
plurality of second data obtained by said re-encoding 
15 means in said recording medium. 

10. The mobile terminal according to claim 9, 
wherein , when a transmission encoding means for 
encoding the original data to be transmitted into first 
data and a plurality of second data and transmitting 

20 them wirelessly is provided, 

said transmission encoding means functions also as 
said re-encoding means. 

11. The mobile terminal according to claim 5, 
wherein said data reproduction processing means 

25 reproduces original data according to a data decoding 

scheme specified in MPEG-4 (Moving Picture Experts 
Group- 4 ) . 
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